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BACKGROUND OF THE INVENTION 

1. Field of the Invention 
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. 2. Description of the Prior Art 

Heretofore, as described in Japanese Laid-Ooen Patent HEI i-?ftifinn «™= ~« 
recognizing a preceding vehicle have traced edgfs exSSed from . UCh aPP3ratUS for 

existing region 9 extracted from images to extract a preceding vehicle 

SUMMARY OF THE INVENTION 

-Ksnris: iar:srs;« 

f^recogmzmg the preceding vehicle from the inputted images and an intervehicle d£2TS12SS 
Z££L " 9 , ^ diStanCe to *• rec °9" i29d P""** vehicle to perform pmcess^g TrTeTh S 

^STZSTST^ ^ 6XtraCti ° n SUbSeCti ° n f ° r flPP,yin9 ^entialVocessing to mT^d 
TySinTZt , * 9 T m0r,eS 10 eXtr3Ct ed96S ' a traff5c lane re 9ion extraction subsection for 

!.tS^ 9 . ,an9 re9i0nS fr0m the road ima 9 es in «» image memories, an edge searchino 

subsection or extracting vehicle candidate regions from the road images stored in the image memoes a 
Wetnca. region extraction subsection for extracting right/toft symmetrica. ^orTZn ZZ^ 
cand.date regions searched from the edge searching subsection to limit further the vVhtele candidate 

eoio^xlSf" 9 TUT ^ T ^ m ° de,S f ° r *" Symmetri ^ exiractTS tte 

Zn£T^* e extraction subsect.on. and a vehicle contour extraction subsection for extracting 

P Ti 8 V9h,C J e °" *" baSlS ° f *• s V mmetrical regions extracted by the syZeS 
SSL^STT "ST? 1 ^ ° f th9 ln,ormati ° n °" s "apes of models set by the initial model seS 
ZS„« I * meaSUrinfl SeCfi ° n a shi « Pattern . preparation subsection for 

221? per ! ormm 9 a shift oP^n wi »" Wet to a reference pattern, a disparity eS action 

£ ^ElZSl 9 ^ TST" 1 Pr6pared by thS Shift P attern P^ration subsection^ith ££22 
and a^™£ T estab 1 h8hm 0 a "Nation between both the patterns so as to extract a disparity 

E£Z£££!TZ! ST SUbSeCtl '° n f ° r Ca ' CU,atin9 * e '"tervehicle distance on the basis o 
the d IS panty extracted by the dispanty extraction subsection and of camera positional information 
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BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 is a block diagram showing a basic composition of an embodiment of the present invention. 

Fig. 2 is a view showing an example of installation of cameras on a vehicle. 
5 Fig. 3 is a flowchart showing an operation of the embodiment of the present invention. 

Figs. 4 (a) and 4 (b) are views showing examples of stereo images. 

Rg. 5 is a flowchart showing an operation of the vehicle recognition processing. 

Rg. 6 is a view showing results obtained by extracting edges from an inputted image. 

Rg. 7 is a flowchart showing an operation of the vehicle region extraction processing. 
to Rg. 8 is a typical view showing a processing for extracting white line contours. 

Rg. 9 is a view showing results obtained by extracting the white line contours. 

Rg. to is a view showing results obtained by extracting traffic lane regions. 

Rg. 1 1 is a view showing a method of extracting adjacent traffic lane regions. 

Figs. 12 (a) and 12 (b) are typical views showing a concept of a processing for extracting the lower 
is ends' of vehicle candidate regions in the edge searching processing. 

Rgs. 13 (a) and 13 (b) are typical views showing a concept of a processing for extracting the right/left 
ends of vehicle candidate regions in the edge searching processing. 

Rg. 14 is a view showing results obtained' by extracting the vehicle candidate regions by the edge 
searching processing. 

20 Fig. 15 is a view showing a processing range in the symmetric region extraction processing. 

Rg. 16 is a typical view showing a processing concept of the symmetric region extraction processing. 

Figs. 17 (a) and 17 (b) are views showing results of the symmetric region extraction processing. 

Rg. 18 is a flowchart showing an operation of the symmetric region extraction processing. 

Rg. 19 is a view showing an initial model of Active Contour Models. 
25 Fig. 20 is a view showing a setting state of the Active Contour Models. X. 

Rg. 21 is a yiew showing a method of minimizing an energy of the Active Contour Models. 

Rg. 22 is a flowchart showing an operation of the contour extraction processing by the Active Contour 
Models technique; 

Rg. 23 is a view showing results obtained by extracting vehicle contours by the contour extraction 
30 processing. 

Rg. 24 is a flowchart showing an operation of the intervehicie distance measuring processing. 
Rgs. 25 (a) and 25 (b) are views showing results obtained by extracting vehicle contours from Figs. 4 
(a) and 4 (b). 

Rgs. 26 (a) and 26 (b) are views showing contour models of Ihe contour extraction results shown in 
35 Figs. 25 (a) and 25 (b). 

Rg. 27 is a view showing a shift pattern for disparity extraction. 
Fig. 28 is a view showing a shift operation for disparity extraction. 
Rg. 29 shows an example of the output to the display. 

40 DESCRIPTION OF THE PREFERRED EMBODIMENTS 

With reference to drawings, an embodiment of the present invention will be explained hereinafter. 
Figs. 1-A and 1-B are block diagrams showing a basic composition of an embodiment of the present 
Invention. The numerals 1a and 1b indicate a pair of cameras for picking up an object in front of a vehicle 

46 and installed on the front side of the vehicle in a manner not to prevent the field view of a driver as shown 
in Rg. 2. The numerals 2a and 2b indicate A/D converters each for digitalizing analog image signals 
inputted from the video cameras i and 2. The numerals 3a and 3b indicate image memories for storing 
road images digitalized by the A/D converters 1 and 2. The numeral 4 indicates a ROM (Read Only 
Memory) for loading programs describing processing contents of the present invention; and the numeral 5 

so indicates a RAM (Random Access Memory) as a work memory for storing programs or data. The numeral 6 
indicates an image processing MPU (Micro Processor Unit), whose processing contents are broadly 
classified into a vehicle recognition section 6a for extracting contours of a preceding vehicle, and an 
intervehicfe distance measuring section 6b for measuring a distance to the preceding vehicle, as shown in 
Fig. 1-B. The vehicle recognition section 6a further comprises an edge extraction subsection 61 for 

55 extracting edges from the road images, a traffic lane region extraction subsection 62 for extracting traffic 
lane regions, an edge searching subsection 63 for extracting vehicle candidate regions, a symmetric region 
extraction subsection 64 for extracting right/left symmetric regions in the vehicle candidate regions 
. extracted by the edge searching subsection, an initial model setting subsection 65 for setting an initial 
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Zfn!, f 0, h AC S. Ve C ° nl ? U I ^/,0de,S • and 8 VehiC,e Contour extraction subsection 68 for extracting vehicle 

ZTZlTlZlnZ Contour Mode,s technique - ^ intervehici ° dista "~ »™5 

with respect to a reference pattern, a d.spanty extraction subsection 68 for deterrrtininq a disparity between 

calculating the d.stance to the precedmg vehicle. The numeral 7 indicates a display controller for 
performmg vanous settings on a display 8 for displaying processing results. The numS 9^3S Z 

ZZT™Z7TT 9 V *T S application functions -n g ; 

this apparatus, such as an autocru.se for cru.sing the vehicle with the distance to the precedino vehicle keot 

s^na s by the use of a pair of the stereo cameras 1a and 1b. Then, these analog imaoe sianals are 

20 Ro^a J »n P„ ^ ? eXamP ' e ° f 819,80 road ima 9 es tf 1 " 8 P' cked "P- The image shown in 

• viL ca^eTa 2 P ^ ^ video that shown in Rg. 4b is an input image from the 

the Iten"/^ 6 , 81 * 3000 °!,, R9 - V* PreCedln9 Vehicte is "^nized from the road images picked up at 
imfn^- * "'I 0 *?" 9 V ° h|C, ° recoanltion Pressing, a pair of stereo images are subject to the 
. rSZer^' ~ ^ »!* *«* me video camera 1 J 

Rg. 5 shows a flow of a series of processing for the vehicle recognition processing 
^ 31 !2 °L F f *' 3 differential Proccesing is applied to the road images picked up at the 

S P ,^S °J? 9 u 3 to SXtraCt ed9SS - A 3 X 3 80081 fi,ter is used to e *™* edges, and differential intensities 
obWMd I for each pixel are stored in the image memories 3a and 3b. Rg 6 shows relute tZtZ Z 
2?2 «-o values the differentaJ intensity EE (x. y) by the use of the threshold Eth. The thiLd E^ varies 
UJ?! /3 hTJ C T ,he " k6 ° f Vid8 ° Camera 1 ' a ra "9* in vvhich nine 8-bit g/adation 

SMT - ° f SUD,raCt9d Jn ^ 3 ^ fr ° m ° t0 1530 ' 80 that » is I™*"** that the uWstS 
Eth is set within a range from 80 to 120 : Points . shown with black in Rg. 6 are pixels havinq a differenUal 
•ntens.ty exceeding, the threshold Eth. which pixels will be called edge pixels hereinafter d,fferential 

nf h StBP 32 °1 ° f F '" 9 - *' traffi ° ,a " e fB9l0nS 8,9 extracted from the ™ d ""ages. The flowchart 

of Rg. 7 shows a ser.es of processing for the vehicle region extraction processing. In this case, in order to 
improve a contour extraction accuracy of white !ines. the processing region is limited to the lower half 
p onion oT images. 

At the step 3201 of Rg. 7. the contour of the left-hand white line painted on a road is extracted. Rrst as 

fhTJr! SL JT' T f^T 1 IT Centor " ne ° f resDdctiv * **n™9 Hnes in the left direction. 
Then, an Inrtial position .at wh.ch the d.fferential intensity E (x. y) of each pixel determined at the step 3100 
of Rg. 5 exceeds the threshold Eth is taken as the contour point of the left-hand white line in the scanning 

•» "!? 1? f 02 ° f F ' 9 ' 7 ' <he contour of *• right-hand white line is extracted. In a similar manner 

to the left-hand whrte l.ne. the pixels of the contour of the right-hand white line are scanned from the center 
line of respecftve scannmg lines of Rg. 8 in the right direction, and an initial position at which the differential 
ntens.ty E (x. y) exceeds the threshold Eth is extracted as the contour point of the right-hand white line in 
the scanning l,ne. Rg. 9 shows results obtained by extracting the contour point row of the right/left-hand 
whrte lines. Pixels shown with black point are the contour points of the right/left-hand white lines 

Then at the step 3203. the contour point row of the left-hand white line extracted at the step 3201 is 
approximated in straight line. p 

♦ '"oLo' 11 " 8 ' m8nner " 8t the Step 3204> ^ contour point "> w of right-hand white line extracted at the 
f^Ll 2 ^ , l L~? roximated ,n ^te" 1 « ne - ^ technique of the Hough transformation (U.S. Pat. No 
3.069.654 (1962)) is used for the straight-line approximation of point rows performed at the steps 3203 and 

55 3204. 

Further at the step 3205. a region formed with the left-hand white line approximated line, the right-hand 
white line approximated line, the image lower end. the image left end and the image right end is extracted 
as a traffic lane region in which the apparatus-mounted vehicle cruises. Rg. 10 shows results obtained by 
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extracting the traffic lane region in which the apparatus-mounted vehicle cruises. The region surrounded by 
the VLBA is the extracted traffic lane region. . 

Furttierat the step 3206. adjacent right/left traffic lane regions adjacent to the apparatus-mounted 
vehicle traffic lane region extracted at the step 3205 are approximately determined. In this case, as shown 
* IH % . . tnan9,e VC ° obtawined b V extending double rightward/Ieftward the length of the base LR of 
the triangle VLR indicating the apparatus-mounted vehicle traffic lane region is extracted as the road image 
including the adjacent traffic lane regions. 

I* 19 "^ the ^ 3300 ° f Flg * 5 " the distr ^o" of edges scattered in the traffic lane region extracted at 
the step 3200 is checked to determine the preceding vehicle existing candidate region. 

Figs. 12 and 13 show typical views showing the concept of the processing. First, as shown in Fig 12b 
a processing region is limited to the apparatus-mounted vehicle traffic lane region extracted at the step 
3205 of Fig. 7. Then, in the processing region, the number of pixels having an edge intensity exceeding the 
ttireshold Eth (called edge pixels) is counted for each scanning fine to prepare a histogram as shown in Fig. 
12a. At the same time, an average coordinate position of these edge pixels in the scanning line direction is 
determined and taken as the gravity center Gx of the vehicle candidate region in the scanning line direction 
The axis of ordinate of the histogram represents respective scanning lines, while the axis of abscissa 
represents the number of edges pixels. Then, a threshold Bth is set with respect the number of edges 
pixels. The experiment performed using various images resulted in that the threshold Bth is preferably set 
to about 40. Among scanning lines in which the number of eges pixels exceeds the Bth, the scanning line 
positioned at the lowest position is extracted as the lower end of the vehicle candidate region. In Rg 12a 
the scanning line shown with B indicates the lower end of the vehicle candidate region. Where such 
scanning line satisfying the above-mentioned conditions is not extracted, the preceding vehicle is judqed 
not to exist. 

On the contrary, where the lower end of the vehicle candidate region is extracted, the right/left ends of 
the vehicle candidate region are extracted. Figs. 13a and 13b show typical views showing the concept of 
the processing. First, as shown in Rg. 13a, a processing region is limited to the road region, including 
adjacent traffic lanes extracted at the step 3*06 of Fig. 7 and to the region surrounded by the towW end of 
the preceding vehicle candidate region extracted by the preceding processing and the right/left ends of the 
image. The reason why such processing range is set is that the adjacent traffic lanes are observed at all 
times for the traffic Jane change of the preceding vehicle or the interruption by another vehicle. Within the 
processing range, the number of edge pixels is counted for each vertical pixel column perpendicular to the 
scanning lines to prepare a histogram as shown in Fig. 13b. The axis of abscissa of the histogram 
represents the lateral coordinates of the image,, while the axis of ordinate represents the number^of edge 
pixels. In this case, as apparent from Figs. 13a and 13b, it is understood that in the region outside the 
candidate region in which the preceding vehicle exists, compared to the inside of the vehicle candidate 
region, the frequency of the histogram rapidly decreases (P) and its dispersion becomes small (Q). Then 
according to the following procedure, the right/left side ends of the vehicle candidate region are extracted! 
Rrst, small windows having an interval width Sw are provided with respect to the axis of abscissa of the 
histogram. Then, while calculating the mean value Emean and dispersion value Esigma of the edge 
frequency in the small windows, the windows are caused to be shifted from the gravity center position Gx of 
the vehicle candidate region to the outside rightward/Ieftward. Then, initital positions at which the Emean 
becomes the threshold Mth or less and the Esigma becomes the threshold Sth or less are extracted as the 
left end and the right end, respectively, of the vehicle candidate region; Preferably, the small window 
interval width Sw is set to abount 20 pixels; the threshold Mth for the Emean. to about 15 pixels; and the 
threshold Sth for the Esigma, to about 17 pixels. Rg. 14 shows results obtained by extracting the vehicle 
candidate region by the above-mentioned processing. 

At the step 3400 of Rg. 5, symmetrical regions are extracted. Generally, the preceding vehicle 
displayed on an iamge screen shows a substantially symmetrical shape with a segment perpendicular to 
sanning lines taken as a symmetrical axis. Thus, within the preceding vehicle candidate region defined at 
the step 3300, the symmetrical region is extracted, thereby further limiting the preceding vehicle existing 
region. 

According to the typical views shown in Rgs. 15 through 17, the outline of these processings will be 
explained. Rrst, as shown in Rg. 15, the processing range in which the symmetrical region is extracted is 
limited to the region within the preceding vehicle candidate region defined at the step 3300. Then, within 
the processing region, a symmetrical axis perpendicular to sanning lines is determined. For example, as 
shown in Fig. 16a. assuming that a symmetrical point with respect to the point A on the same scanning line 
is the point B, their symmetrical axis S2 passes through the mid point between the points A and B. 
Although no view is shown, on the same scanning line for the. points A and B, there can be another pair of 
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symmetrical points (thus, there can be another symmetrical axis). In a similar manner assuminc that a 

l^SSt * 7118 P0Sit, '° n ° f SU ° h «*™»«*- — •» calculated for each 
edge po nts distributed in the process.ng region to prepare a histogram as shown in Fiq 16b Then the 

^"S2^^ , L , 5 IST ,S eXtraCted " 3 «** The sym 9 meVica.?4Lt 

extracted by search ng edge points becom.ng a pair with respect to the symmetrical axis. 

the 2£ l^l-^^irj; ***** V™, ° f process ' n 9- R rst . through the processing performed at 
the steps 3401 through 3413. the symmetncal axis is extracted. At the steps 3401 and 3402. an initial value 

70 me step 3300 of Fig. 5. wherein y coordinate of the upper limit Is expressed in Ty; that of the lower limit in 

*e d fferentjal intensity E (x. y) at the coordinate (x. y) in the image exceeds the threshold Eth aTshoZ Z 
the steps 3404 through 3408. a mid point between the coordinate point and each pixel which . to^lE7<2 

is IddedToVh^J 7 "" f 3 "IT" lntenSity eXC8edi " 9 th ° threshold'*!, Is determined, and 
3*0 341 1 C °: esp0nd,n9 to ,he mid P° int P° si « on * *e step 3406. As shown at the steps 3409. 

™ £m!F£^J£?^ V^T! f ° r e3Ch edfle "** Withi " *•• P roces ^9 ^9ion. Then at 
the step 3413. the peak of histograms thus obtained Is determined and stored with the x coordinate at that 

ISl^S Symmetr ' Ca '/ e9i0n with ^P"* to symmetrical axis xsym thus determined is 

fnixSTv^'" 9 IT" 8fter Pr0CeSSin 9 re « io " ,S « the **• 3414 and 

at^i n it Y> *;° se . d '« 9rent ' al '"tensity exceeds the threshold Eth is confirmed at the step 34 1B a 

tiSZ^TSJ^r^S the . S r metriCal ** iS at the step 3417. Tnen at the step 

2vm" £EZL f rem,al inten5,ty eXC9edS *• thresho,d » is P rese "t symmetrical axis 

KSfS I KL".'''"^ I P8ir ° f th9 d8termined ^^tricai points are registered at 
sit™ J£ JET '" 9 ' S P?**?"* for each «dge point within the processing region as 
shown at the steps 3420 through 3423. Finally, a rectangle circumscribing the symmetrical, reaton is 

n*Sn?£ 1 S 7 / a mmetrical re9,0n: and R * 17b . show * « ^actahgular region circumscribing the symmetrical 

wiiJSlL 8 ! 1h A!l eP ^ 500 of R 9- 5 ' to the symmetrical region extracted at the step 3400. an 

initial model of Active Contour Models is set. 

„ J? ,ni ^ a, ^ odel has a shaDe approximating a vehicle, shape as shown in Fig. 19. and comprises a 
ThTS^ IT^^TK ' nterVa,S - Th9 fi9Ure " 0f npdes in ^is case is p eferab^bo^ 

sTo aS b? a ^ a 9 , * 2 m ,°/ ** m0de ' ^ ^ by mU,tip,yin9 of 1,19 W a " d H determined at the 

SSJ^iiL r r ^ 8 Param8ter P iS Preferab,y S9t to a ra "9 e 105 to Fu*™> *9 initial 

mode ,s mstaMed ,n such a manner that the gravity center Cm of the initial model is matched to the gravity 

symmetnc reg.on determined at the step 3400. whereby the initial value of the Active 
Contour Models can be set to a proper position with respect to the vehicle region 

n , At 3B °V a RQ - 5> the contour of the Preceding vehicle is extracted by the use of the Active 

ao Contour Models technique. The dynamic contour model is a technique by which an energy function 
Esnakes ,s defined from the characteristic of an Image: and the shape of a model, and in the process of 
mmimizmg the energy function, the contour of an object is extracted. Th* energy function Esnakes is 
composed of an internal energy Eint as a force relating to the shape of a model such as smoothness and 
internode distance, an Image energy Eimage as a force by which the model is drawn to the image 
46 charactenstc. and an external energy Econ as a force to restrain externally the change in the shape of the 
mode . and is expressed as in the equation (1). wherein vi (i = 1. 2. 3. - - n) is a node of the contour 
model. 
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Esnakes (vi) = Eint (vi) + Eimage (vi) + Econ (vi) (1) 

Further, the internal energy Eint can be calculated by the equation (2). a and fi are weight parameters 
for each term. 

Eint (vi) = a Jvi - vi-1|2 + 0|vi-1 - 2vi + vi + 1|2 (2) 

The image energy Eimage as a potential field from edges in an image is calculated as a density 
gradient on the image as shown in the equation (3), wherein r is a weight parameter for the image energy. 
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Eimage (vi) = - r | VI (x, y)| (3) 

r *Jlt*°t eXterna] f'W-* 001 ^*^ the symmetricalness of the preceding vehicle, there is given a 

ZZ^u^ m ^*^ 80 ^ C ° nt0Ur model is symmetrically, 3^^ ^ 

equabon (4), where.n g is a gravity center coordinate of the contour model; vNs a symmetriLrS of Z 

i:z:^ 9 t symmetricaI ■* passing through 9ravrty c: ^ 5 is a 

Econ (vi) = « | jvi - g| - | vi* - g| j (4) 

medir^nrZ^^ 0 " Esn ? es u thus defined is evaluated In the region near each Joint of the contour 

causing the model to be contracted. Where the number of nodes to be shifted becomes a certain threshold 
or less, the contour model is judged to be converged to finish th. model contraction. Figs. ™-A and Sb 

3 °^°^ r0< ? SSin9 - ?T St6pS 3601 ind 3602 ' the are in^alSd 

. ««r5^ 3603, ** Esnakes ,s calculated according to the equations (1) through (4) Then at the 
step 3604 .ft. Esnakes calculated at the step 3603 Is compared wift *»JJ£7& 1 !^^ 
Where the Esnakes ,s judged to be smaller, at the step 3605. the Esnakes is held I as the mlnSSTvSof 

and then the process returns to the step 3603. On the contrary, where the Esnakes is judged to be tamr 

USSZ 3603 "" h6ut 0pda8n9 ^ m ' nimUrtl of *• energy J On^ ba^s ofthe 

12 ™ J? i ^ I 8 processin 9 is for «ach ^acent regions previously set. Then at the 

■Xf2 9 V3 i Ue ° f ^ fina ' enef8y ,s judoed to °° stained at current positions of 

«™„ 1 h ^f! S f *V S PrOCe8dS 40 1,16 3810 - 00 1,16 minimum value of the 

1ZI V '"SS 5 * • he - a * cent P**' 8 at Portions other than the current ones of the nodes 

l^Tn S'VZ n0d6S Shmed t0 *• P 05 "' 0 " 8 of ad,acent P* e,s ' and the p ™** P^s to 2 
iSLf h * T t COnCept * the P rocessin 9 at »"ese steps. Then at the step 3610. a parameter is 
fl Qa t^ the " ° n . th9 A b f 1S of ^ment at the step 3611. the processing from 3602 to>3611 is 

-,ap 36t1 " wh8re *° Processing for each node is judged to be finished, the 
^£^^2?,"^ V? ? 6P 3612 iS eva,uated - ^ where the figure is the threshold value or less. 
n^2^TJ22? '"J 9 . J° ? T^' fini5hin 9 11,6 Processing. On the contrary, where the 

number of shifted nodes is the threshold value or more, the process returns to the step 3601. at which the 
Processing for each node is repeated again. The above-mentioned processing allows the contoiir of the 
preceding vehicle to be extracted from the road image. 

™ Th !!!, at A the 2" P 4000 ° f n9 ' *' a distance to Preceding vehicle recognized at the step 3000 is 
mea^red. According to the principle of triangulation. the intervehicle distance is calculated by extracting 
1 and 2 Preceding vehicles on a pair of stereo images picked up from the video cameras 

pi, J^^^lUT 9 ' f 4 l h0WS 8 5eri6S ° f the ,,OW 01 Uie '"tervehicle distance measuring processing. 

«t 8 ^ ' ° n ** 688,8 ° f the Contour '"formation of the preceding vehicle extracted at the step 
3000 of Fig. 3. a pattern to extract the disparity between stereo images is prepared. 

Figs. 25a and 25b show results obtained by extracting the contour of the preceding vehicle from the 
stereo images of Figs. 4a and 4b. respectively; and Figs. 26a and 26b represent only the contour models 
among the extracted contours. Fig. 27 is a view obtained by reversing the contour model of Fig. 26a with 
respect to the symmetric axis of the preceding vehicle extracted at the step 3400 of Fig. 5. The reason why 

■J? « f Ca T ,d t0 ta reversed witn ^P** to th e symmetric axis is that a distortion between the 
right/left images due to stereo vision is to be corrected. 

Then at the step 4200 of Fig. 24. with the reversed contour model taken as a shift pattern and the 
contour model of Fig. 26b taken as a reference pattern, while establishing a correlation between both the ■ 
patterns, a shift operation is performed in the scanning direction. Fig. 28 shows a conceptional view of the 
S \Z f 08 ^ 0 "- ^ a correlation, the degree of overlapping of coritour lines in both the patterns is used. The 
shift by which the correlation becomes the maximum is extracted as a disparity d between both images 

Then at the step 4300 of Fig. 24. by the use of the disparity extracted at the step 4200. the intervehicle 
distance Is calculated according to the equation (6). 
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Distance D- 



Intercamera optical axes 

distance DB x focal length f 

disparity (pixel) d x pixel size PS 



(6) 



It is preferable that the distance DB between the optical axes of the video cameras 1 and 2 is about 1 m, 
and that the focal length f is about 7.5 mm. The pixel size PS to be used , which varies with image pick-up 
devices used, has preferably a resolution as high as possible. 

At the step 5000 of Fig. 3. the distance to the preceding vehicle calculated by the above-mentioned 
processing is outputted. The output of the results is performed by a display installed in the vehicle 
compartment. Fig. 29 shows an example of the output to the display. Ah output terminal such as RS232C is 
provided to implement various application functions using intervehicle information calculated by this 
apparatus, such as an autocruise for cruising the vehicle with the distance to the preceding vehicle kept 
constant, or an intervehicle distance alarm device for alarming the driver if the distance to the preceding 
vehicle becomes a certain value or less. 

Although in the embodiment of the present Invention, the Sobel filter has been used in performing edge 
extraction from images, any filter capable of extracting edges from images such as Laplacian may be used. 
Although in the traffic lanfc region extraction processing, the Hogh transformation has been used in straight- 
line approximating the contour point row of white lines, any straight-line approximating technique such as 
the method of least squares may be used. Although in the embodiment of the present invention, the model 
representing the. shape of an ordinary automobile has been uesd as the initial model of the dyanmic contour 
model, a model assuming the shape of other vehicle types such as large trucks may be used. 

Claims 

1. A vehicle recognition apparatus which recognizes a preceding vehicle from road images inputted by a 
use of vehicle-mounted video cameras and measures a distance to the recognized vehicle, comprising : 

stereo image input means mounted on a vehicle for picking up stereo road scenes in front of the 
vehicle; . 

image storage means for storing the road scenes information inputted from said stereo image input 
means; 

edge extraction means for applying a differential processing to the road scenes information stored 

in said image storage means to extract edge ; 

traffic lane region extraction means for extracting a traffic lane region from the road scenes 

information stored In said image storage means- 
vehicle edge searching means for searching a distribution of the edges extracted by said edge 

extraction means within the traffic lane region extracted by said traffic lane region extraction means . to 

extract the preceding vehicle existing region candidate from the road scenes information stored in said 

image storage means; 

symmetric region extraction means for extracting a symmetric region within the preceding vehicle 
existing region candidate defined by said vehicle edge searching means and for limiting further the 
preceding vehicle existing region candidate ; 

initial model setting means for setting an initial contour model for the preceding vehicle existing 
region candidate defined by said symmetric region extraction means; 

contour extraction means for extracting contours of the preceding vehicle from the road scenes 
information stored in said image storage means on the basis of the Initial values set by said initial 
model setting means; and 

intervehicle distance measuring means for measuring a distance to the preceding vehicle on the 
basis of the contour of the preceding vehicle extracted by said contour extraction means. 

2. A vehicle recognition apparatus as set forth in claim 1, comprising; 

traffic lane region extraction means for extracting a self traffic lane region in which self vehicle 
cruises from the road, scenes information stored in said image storage means, and then extending 
double rightward/ieftward a traffic lane width indicated at a lower end of the road scenes by the 
extracted traffic lane region f to obtain right/left approximately adjacent traffic lane regions. 
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a A vehicle recognition apparatus as set forth in claim 2, comprising; 

WHS.? 1 ? 8 6 ?! e ^f on means for extracting a lower end of the preceding vehicle region candidate 
wrthto the self traffic iane region extracted by said traffic lane region extraction means, and then 
extracting nght/left side ends of the preceding vehicle region candidate within the adjacent traffic lane 

regions. 

4. A vehicle recognition apparatus as set forth in claim 3, wherein; 

the vehicle edge extraction means extracts region ends of the vehicle region candidate on the basis 
of disperse values of a number of edges extracted from a inside of the traffic lane region. 

5. A vehicle recognition apparatus as set forth in claim 1, wherein ; 

the symmetric region extraction means adds up mid-point positions of between edges which is 
present on the same scanning line ( to extract symmetric axes of a whole region. 

6. A vehicle recognition apparatus as set forth in claim 1, wherein ; 

the initial model setting means determines shape and size of model adapted to the preceding 
vehicle existing region candidate defined by said symmetric region extraction rheans on the basis of 
region width and height of the preceding vehicle existing region candidate. 

7 f A vehicle recognition apparatus as set forth in claim 6. wherein; 

the initial model setting means matches a gravity center position of the preceding vehicle existing 
region . candidate to a gravity center position of the model , to set automatically the model to a proper 
position. 

a. A vehicle recognition apparatus as set forth in claim 1, wherein; 

the intervehicle distance measuring means for performing a shift operation in such a manner that 
among the vehicle contours extracted from the rightrleft stereo road scenes, the contour of one road 
scene is reversed with respect to its symmetric axis and is made a shift pattern, and that of the other 
road scene is made a reference pattern .and for extracting a shift amount by which a correlation value 
of both the patterns becomes minimum , as a disparity between both road scenes , thereby calculating 
the distance to the preceding vehicle. 
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FIG. 1-A 
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FIG. 1-B 
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